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. ABSTRACT 


The relationships between students'. ratings of typical 
instructors (RTI) and specific course instructors (RSI) were 
| explored. Correlations between RTI and RSI were generakty | 
significant but relatively low (.07 - .24). A stepwisegregres- 
sion procedure indicated that RTI could accent for about 8% 
of the variance in the overall rating given a specific tnetruce 
tor; individual RSI items accounted for about 608. The data 
indicate that instructor ratings taken at the end of a course 
are relatively free of bias from generalized attitudes about 
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Student Ratings of Typical and 


Actual Instructors (CTQ) i * 
aback fags and Thomas Andre 
With the onset of the student rebellion’ of the 1960's, 


concern for the evaluation of. college instructors has grown. 


One nati festation of ones: concern is the increased use of Sevoney 


rating forms. Stich ee are typically filled out by. students P| 
a 


near the end of courses and include items adnigned to gat student’ s 
opinion ere the qualities of the instructor. Faculty member 
reaction to such ratings varies from widely enthusiastic to | 
strongly disparaging. A common eeaana a is that the ratings 
reflect merely the student's generalized ee ee instructors 
and courses, not an objective evaluation of a specific instructor. 
As Kulk and McKeachie put it, "some students are easily pleased 
Nand others never satisfied" (1975, p. 214). 

This view is supported by a study reported by Rosenshine 
(1973) . _ Rosenshine found chat relationships between student's 
end of course ratings. and teacher behaviors disappeared if a 
sreccatting of, the instructor were factored (put. Rosenshine 
argued that if the residual variance in post-ratings was not 
related to teaching behaviors, then the post-ratings were of 


little meaning. However, Rosenshine himself noted that his pre- 


rating measure was' questionable. ‘Essentially. his measure was a. 


rating of the instructor taken a mowth after classes had started. 
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Given a month of instruction it seems likely that students had 
formed opinions about specific instructors. Thus the pre- 
rating probably did not truly reflect generalized attitudes. 
The purpose of the present study was to examine the re- 
lationships between students' generalized attitudes towards 


instructors and courses and their end of course ratings of 


specific. instructors. Contrary to Rosenshine, the initial rating 


pre-measures were obtained before students would have had any 


chance to form opinions of the specific instructors. 


METHOD ie 


Subjects 


The subjects were 460 students (173 males and 287 females) 

( : 
attending five undergraduate. psychology courses at Iowa State 

University. - ‘ \ 


ry 
\ 
\ 


Materials 

s " the teacher rating questionaire which was used was based 
on the standard form available at Iowa State University, The 
form contained a total of 25 items. The first eight items © 
requested background information such as sex, sandagle alee, 
and class year. Also included in this group of items was an 


item: asking each student to rate his/her interest in academic 


work. The next 16 items requested ratings of, various teacher 


characteristics and behaviors. The last item requested qn overall 


rating of the instructor. 


During the first week of the academic quarter, tha“atadenks 
were asked to fill out the rating form on the basis of their 
opinions about typical instructors in courses similar in size 
and nature to the course in which the form was administered. 

The same rating form was administered again during the last 
week of the quarter. However, each student this time was instruct- 
ed to rate the specific’ instructor of the course they were pre- 


sently attending. \ 


RESULTS ; 
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'. -Pearson correlation coefficients were computed between | 


Ratings of fe sae ie (RTI) and Ratings of Spécific 


Instructors (RSI). These correlations ranged ftom -07 to .24. 
ee % 


(See Table 1) ' All nak the smallest was significant (alpha = .01). 
To further assess the effects of prior attitudes on RSI 

‘a secondary re ere employed. Based upon factor analyses 

of rating data, French-Lozovik (1974) had reported that overall 

ratings of instructors could be predicted very well (multiple 

Rs about .95) from scores on three factors labeled: 1. Clarity 

of Exposition 2. Arousal of Interest and 3. Stimulation of 

iinking. Scores on other factors contributed little to overall 

rating. Since overall’ratings of instructors are often used 

as summary descriptions of teaching quality by evaluation commit- 

tees it- seemed Taper wane. be assess the specific contribution of 


RTI to teachers' overall ratings. 
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Accordingly, the /individual items data from the present 

study were factor 3 alyzed (Principal Components Analysis/ 

Varimax Rotation). Three factors emerged which were labeled: 

1. Clarity of Exposition (CE) 2. Attitude towards Students 

(AS). 3. aids to Student Understanding of Course Material (ASUC). 

(That“Arousal of Interest and Keim ion of Thinking factors 


dia not emerge is probably due to agk of such items on the 


/ standard Iowa State rating form). Factors scores on these 


factors were used to predict overall ratings in two stepwise 

regression procedures. In the first procedure factor scores 

from RSI were used to predict overall RSI. In the second step- 

wise procedure factor scores based on RTI and the background : ' 
variable of class year were entered intdéd the regression equation 

prior to the RSI factors. In this way the abteniation tn the 
predictability of svexall Bsx rating dué° to prior attitude could 

be assessed. The results of these first analysis yielded the 


following: multiple R* (3,456) = .84, p<.01; CEpg; accounted 


for 59% of the vertantes Aepey for 10% and ASCUMpcy for 2%. 


“In the second analysis the model was: OVERALL RSI = CEprr + 


multiple R2 of .84 resulted. The important result is that RTI 


and class year factor only accounted for about 8% of the overall 


. variance. The contributions of the RSI factors were as follows: 


CEpsr = 52%, ASpcoy = 5%, ASCUMpc; = 7%. These results suggest 
that most of the variance in overall ratings of instructors 


can be attributed to the students perceptions of the individual 
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‘tionship between pre and post rating data were incorrect. ‘ Rosen- 


¢ 


‘qualities of the instructors, not to prior.attitudes and back- 


ground variables. 

Two factoral analyses of variance including student back~ 
ground variables were performed. whe dependent measures were | 
total RTI and RSI.; The three factors were Class year (1-4) X 
Sex (M vs F) X Level of academic interest (High, Average, Low). 

In both analysis only the effect of Level of Academic Interest 
was significant, F (2,437) = 17.65 p<.0l, and F (2,437) = 
4.46, p<.0l1 respectively. Average rating of instructor declined 


as level of interest decreased. 


CONCLUSIONS 

The results of the correlational analysis of RTI and RSI 
suggest that RTI are in fact related to RSI and that a portion 
of the variance in RSI can be attributed to the students general 
attitudes towards instructors. However, contrary to Rosenshine's 
(1973) data, the degree of the relationship is small. | In the 
Rosenshine study the*total RTI-RSI correlation was 88, while 
in the present study the comparable figure was .28. The present 
results are indies to the findings of Feldhusen and Starks 
(1970, reported in McKeachie and Kulik, 1975 p. 214). These 


results suggest SHRE ROS SnAnSHe |S conclusions about the rela- 


shine's study was a reanalysis of a study reported by Flanders 
(1969). While the original Flander's study had reported cor- 


relations between observed teacher behaviors and student ratings, 
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Rosenshine's reanalysis suggested that those reported correla- 


tions were meaningless because of the pre-post rating correla- 
_ tions. The present data suggest that the Rosenshine reanalysis 


was inappropriate and that Flander's original’correlations are 


meaningful. 
The multiple regression analyses further supports this 


conclusion, in that the attenuation of the predictability of 
/ F 


‘the overall RSI rating by generalized attitudes of instructors 


is small. In fact, these results suggest that most of the 


> variance in overall ratings of instructors can be attributed 


to the students perceptions of the individual qualities of the 
instructor, and not to prior attitudes and general background 
variables. 
The analyses of variance data generally support results 
of earlier studies (see McKeachie and Kulik, 1975) that student 
characteristics such as sex and class year are not strong deter- 
minants of ratings of teachers. However, level of interest in 
academic work does seem to significantly effect ratings of 
instructors. Students whose interest is high, and perhaps 
cendeaent with thous of the instructor, tend to rate instructors 
more favorably than do students with low interest in academics. 
From a practical perspective, the results of this study 


suggest that end of course ratings of instructors can be taken 


if 


for what they are worth without placing much concern about 

the students generalized attitudes towards, courses and instruc- 
tors. Generalized attitude is not an important factor in ratings 
data unless one is attempting to discriminate small differences 
in mean instructor ratings. However, given the normal variance 
in instructor ratings, small mean differences are probably 
meaningless anyway. Unfortunately faculty evaluation committees 
sometimes attempt to interpret small differences in mean rakinwe, 
The fact that portions of the difference may be due to students' 


generalized attitudes should increase the caution with which 


small differences are interpreted. 
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a ae 2. 5 Correlations Between Student Ratings of Typical 
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fa aes Characteristic, Correlation: Coefficient 
7 f 

ge Organization/Planning e | .19** 


Clasé, time efficiency. -24** 
Be sds 7 Preparedness oa : .16* | 
A ‘ ¢ 
Interest -12* 
3 ‘ 


+ : 
_ Oral presentation . ~19** 
AY ‘ 3 


Written ptesentation . .12* 
ee ‘ - Explanatio s 12 


Relevance : -13* 


as ; Respect | 215% 
ba | Tolerance : . oi 
: a Fairness — 22% 
Availability La 
A gy 


are ae .Expectations aa? 


Amount of work -10 4 


4 Relevance of work -10 
aa Evaluation ; .17** 


bof : | ‘Overall Rating | ‘ .13* 


Total Rating i ~28** 
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f ’ e 
‘ 
et 11 
a 
“A 
4 * 
v4 
ek 
an 
te 
’ 


+ Ses Gt 


‘ 


al 


REFERENCES 


Planders, N-A. 


Teacher influence patterns ‘and pupil achievement 
> 


in the second, fourth, and sixth grade levels. ERIC, 1969, 

No. ED 051 123. 

French-Lozovik, G. Predictability of student evaluations of 

college teachers from component ratings, Journal of Educa- 
tional Psychology, 1974, 66, 373-385. 


The evaluation of teachers in 
higher education, in Kerlinger, F.N. 


(ed.) Review of Research 
in Education. 3, Itasca, Illinois: Peacock, 1975. 


Rosenshine, B. Teacher behavior and student attitude revisited, 
‘Journal of Educational Psychology, 1973, 65, 177-180. 


- 


